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Abstract 


The  complex  multivariate  Gaussian  and  Wishart  densities  are  often  encountered  in 
the  analysis  of  statistical  signal  processing  algorithms  in  frequency  domain  array  pro¬ 
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standard  theorems  found  in  multivariate  statistics  for  real  Gaussian  random  vectors  and 
real  Wishart  matrices.  This  memorandum  contains  the  extensions  to  the  complex  case  of 
a  selection  of  these  theorems. 
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STATISTICAL  THEOREMS  INVOLVING  THE  COMPLEX  MULTIVARIATE 
GAUSSIAN  AND  WISHART  DENSITIES 


INTRODUCTION 

The  theorems  found  in  this  memorandum  are  extensions  to  the  complex  case  of  theorems 
commonly  found  in  the  analysis  of  multivariate  real  Gaussian  random  variables.  The 
original  theorems  may  be  found  in  either  Searle  [1]  or  Muirhead  [2],  The  extensions  are, 
for  the  most  part,  straightforward  and  result  from  following  the  proofs  for  the  real  cases. 
When  possible,  the  proofs  have  been  simplified  or  deferred.  Background  and  distributional 
information  on  multivariate  complex  Gaussian  random  variables  and  complex  Wishart 
matrices  may  be  found  in  Goodman  [3]  and  to  a  lesser  extent  in  Anderson  [4]. 


NOTATION 


In  this  memorandum,  boldface  lower  case  letters  represent  vectors,  boldface  upper  case 
letters  represent  matrices,  and  the  superscript  H  represents  the  conjugate  transpose  op¬ 
eration.  If  the  n  dimensional  random  vector  x  has  a  complex  Gaussian  distribution,  the 
notation 

x  ~  CMn  ( A* ,  £)  (1) 


is  used  where  fj.  is  the  mean  vector  and  X  is  the  covariance  matrix.  The  probability  density 
function  of  x  is 


f(x)  = _ - _ 

H)  7r"|£| 

If  the  n-by-n  random  matrix  A  has  a  complex  Wishart  distribution,  the  notation 


(2) 


A  ~CW„(fc,£)  (3) 

is  used  where  k  is  the  number  of  degrees  of  freedom  and  X  is  the  scale  matrix.  The  prob¬ 
ability  density  function  of  the  complex  Wishart  distribution  is  described  in  Theorem  3. 
If  the  scalar  random  variable  Z  has  a  non-central  chi-squared  distribution,  the  notation 

Z  ~  Xl  ($)  (4) 
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is  used,  where  P  is  the  number  of  degrees  of  freedom  and  6  is  the  non-centrality  parameter. 
The  probability  density  function  of  such  a  non-central  chi-squared  random  variable  is,  as 
found  in  Johnson  and  Kotz  [5], 


2-^-ie-l 
■2^ir(P± 2k 


It  should  be  noted  that  Searle  [1]  defines  the  non-central  chi-squared  probablity  density 
function  as  having  a  non-centrality  parameter  equal  to  |  in  equation  (5). 


THEOREM  1 

The  following  theorem  is  an  extension  of  Theorem  2,  Chapter  2,  page  57  of  Searle  [1] 
describing  the  probability  density  function  of  certain  quadratic  forms  involving  complex 
Gaussian  random  vectors. 

Theorem  1  If  x  ~  CMn  (/r,  £)  and  A  =  AH ,  then  2xH  Ax  ~  X f  (<5)  if  and 
only  if  AE  is  idempotent.  The  non- centrality  parameter,  6  =  2pH  Ap,  and 
the  degrees  of  freedom  parameter,  r  =  2fr(AE),  where  tr(  AE)  is  the  trace  of 

AE. 

Proof:  For  the  quadratic  form 

Q  =  2x.hAx,  (6) 

consider  the  moment  generating  function 

MQ(t)  =  E[et<3] 

=  E[e2tx"Ax] 

=  7r--1j^~|  exP  [2*xHAx  -  (x  -  V)H  £_1  (x  ~  M)]  dx 


where  Cn  represents  n  dimensioned  complex  Euclidean  space.  The  exponent,  V,  may  be 
massaged  into  a  single  quadratic  form  in  x, 

V  =  xH  (2tA)  x  —  x^E_1x  +  pH'S~1x  +  xffE~V  — 
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(8) 


=  -(x-/i)flE  1  (x  -  p)  +  V> 


where 


and 


£  =  E"1  -  2tA 


fi  -  ee  V- 

The  moment  generating  function  thus  becomes, 
MQ(t)  = 


(9) 

(10) 


exp 

fiHt  V-Z's-V 

.  i 

r  exp 

-(x-/i)"£  1  (x-/i) 

si 

-i  y 

|£|  J 

C"  7 rn 

£ 

dx 


exp 

'nH\ 

[e-'ee-1  -£_1)m] 

£  !£ 

exp  -nH  (ln  -  E"1  (E"1  -  2tA)_1)  £"V 
|I„  -  2fA£| 

exp  [~nH  (ln  -  (In  -  2tAE)“1)  E- V] 
|In-2fA£|  ’ 

where  In  is  the  n  dimensional  identity  matrix. 

Suppose  that  AE  is  idempotent  with  rank  or  trace, 


(11) 


tr(AE)  =  m.  (12) 

Note  that  the  eigenvalues  of  an  idempotent  matrix  are  either  zero  or  one,  and,  by  using  a 
singular  value  decomposition,  the  matrix  AE  may  be  expressed  as 

AE  =  UV",  (13) 

where  the  n-by-m  matrices  U  and  V  are  orthogonal, 

V"U  =  Im.  (14) 

Part  of  the  matrix  in  the  quadratic  form  in  the  exponent  of  equation  (11)  may  now  be 
simplified, 

In  —  (In  —  2fAE)-1  =  In- (ln-U(2t)Vff)‘1 
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=  I 


"-U(V"U"£I’TV" 

u(1-s)’‘v" 

(‘-rhi) 


AS. 

The  determinant  in  the  denominator  of  equation  (11)  is  clearly 

1 1„  -  2fAS|  =  (1  -  2f)m 


(15) 


(16) 


because  AS  has  m  non-zero  eigenvalues,  all  equal  to  one.  Substituting  (15)  and  (16)  into 
(11)  results  in 


MQ(t)  = 


exp  -  (l  -  jrat)  hhAh 
(1  —  2t)m 


(1-2 1)2? 


(17) 


The  moment  generating  function  of  a  non-central  Chi-squared  random  variable  with  r 
degrees  freedom  and  non-centrality  parameter  <5,  as  found  in  Muirhead  [2],  is 


Mv 2  it) 


6  —J. _ _ 

e  Te2(i— 2t) 


(18) 

(1-20* 

Equating  equations  (17)  and  (18),  it  is  seen  that  the  quadratic  form,  Q,  has  a  non-central 
Chi-squared  distribution  with  r  =  2m  =  2tr  (AS)  degrees  of  freedom  and  non-centrality 
parameter  6  = 

If  it  is  assumed  that  the  quadratic  form  has  the  described  non-central  Chi-squared 
distribution,  it  can  be  seen  that  the  matrix  AS  must  be  idempotent  with  rank  equal  to 
tr  (AS)  =  ^  by  equating  the  denominators  of  equations  (11)  and  (18), 

(l-2f)*  =  |I„-2tAS| 

n 

=  nu-**).  <19) 

i=  1 

where  A*  are  the  eigenvalues  of  AS.  Clearly  the  left  and  right  sides  of  equation  (19)  will 
be  equal  only  when  |  of  the  eigenvalues  are  equal  to  one  with  the  remaining  equal  to  zero, 
which  results  in  an  idempotent  AS  matrix. 
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THEOREM  2 


The  following  theorem  is  the  extension  of  Theorem  4,  Chapter  2,  page  59  of  Searle  [1] 
showing  the  independence  of  quadratic  forms  involving  complex  Gaussian  random  vectors. 

Theorem  2  If  x  ~  CAfn  (p,  E),  A  =  A.H  and  B  =  B^,  then  x^Ax  and 
xhBx  are  independent  if  and  only  if  AEB  =  BEA  =  0. 

Proof:  The  proof  is  identical  to  that  of  Searle  [1]  and,  as  the  result  is  also  identical,  will 
not  be  repeated. 


THEOREM  3 


The  following  theorem  is  an  extension  of  Theorem  3.2.10  on  page  93  of  Muirhead  [2] 
describing  the  probability  density  functions  of  the  partitions  of  a  complex  Wishart  matrix 
and  of  a  particular  function  of  the  partitions  that  enjoys  certain  independence  properties. 


Theorem  3  If  the  n-by-n  matrix  A  ~  CW„  (m,  E)  with  A  and  E  partitioned 
into  two-by-two  blocks, 


A  = 

E  = 


iH 

iH 

◄ 

<N 

iH 

◄ 

1— 1 

◄ 

A22 

1— 1 

1— 1 

w 

CN 

1— 1 

w 

iH 

w 

E22 

where  An  and  En  are  k-by-k,  and  if 


(20) 


Lll-2 


=  An  —  Ai2A221A2i 


(21) 


and 


En. 2  =  En  —  EiaE^Eai, 


(22) 


then 


1.  An. 2  ~  CWk  (m  —  n  +  k,  E112)  and  is  independent  of  A12  and  A22. 
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2.  The  conditional  distribution  of  given  A22  is 

CM fcx(n-fc)  (^12^22^ A22,  Sn-2  <8>  A22)  •  (23) 

3.  A22  ~  CWn-k  (m,  S22). 


Proof:  Consider  the  probability  density  function  of  the  complex  Wishart  distributed  ma¬ 
trix,  A,  as  found  in  Goodman  [3], 

lAlm_” 

/(A)  =  p  -'  -.-  .m etr  (-E->A) ,  (24) 

*  m,n  |^| 

where  ‘etr’  signifies  the  matrix  exponential  trace  operation  and 

rm,B  =  *^r(m)...r(m-n  +  i)  (25) 

where  T  (x)  is  the  standard  Gamma  function.  Applying  the  fc,  n  —  k  factorization  to  the 
determinants  of  equation  (24)  yields 

|A|  =  | A22 1  | An  —  Ai2A221A2i  | 

=  I A22 1  |Aii.2|  (26) 


and,  similarly, 


|E|  -  IE 


22 1 


m-2l 


(27) 


The  determinant  of  a  partitioned  matrix  may  be  found  in  the  Matrix  Theory  Appendix 
of  Muirhead  [2].  The  trace  of  the  matrix  product  E-1A  in  equation  (24)  must  now  be 
massaged  into  a  form  containing  the  matrix  partitions  A12  and  A22  and  the  matrix  An. 2. 
This  requires  substantial  algebraic  manipulation,  beginning  with  the  matrix  factorization 
of  the  inverse  of  the  matrix  E, 


-«-i 


(28) 


V„  V12 
V21  V22 

The  following  relationships  between  the  partitioned  matrix  and  the  partitioned  inverse 
may  be  easily  verified: 


Vn  = 


(29) 
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J22 


v22-v21vr11v12 


VhVij  =  -SiaSJa1. 
Applying  these  to  the  aforementioned  trace  results  in 


(30) 

(31) 


tr  (E  >A)  =  tr 


V„ 

V2i 


Via 

V22 


=  tr 


An  Ai2 
A2i  A22 

ViiAn  +  Vi2A2i  VhAi2  +  Vi2A22 
V2i  An  +  V22A2i  V2iAi2  +  V22A22 
=  tr  (VnAii)  +  tr  (Vi2A2i)  +  tr  (V2i  Ai2)  +  tr  (V22A22) 

=  tr  (Vn  An)  +  2tr  (V  i2A2i)  +  tr  (V22A22) 

=  tr(Vn  [Ah.2  +  Ai2A221A2i])  +  2tr (Vi2A2i)  +  tr (V22A22) 

=  tr  (Vn  An. 2)  +  tr  (V n  Ai2A22  A2i)  +  2tr  (V i2A2i)  +  tr  (V22A22) 
tr  (^li'aAn.a)  +  tr  (VhAi2A22A2i) 

— 2tr  (VhEi2E22  A2i)  +  tr  ([E22  +  V2iV111Vi2]  A22) 
tr  (^li'aAn.a)  +tr  (VhAi2A22A2i)  —  2tr  (VhEi2E22A2i) 
+tr  (E22A22)  +tr  (A^E^EaiVnEiaE^,1) 
tr  (^i/2An.2)  +  tr  (VhAi2A22A2i) 

— tr  (VhEi2E22A2i)  —  tr  (ViiAi2E22E2i) 

+tr(E22A22)  +  tr  (ViiEi2E22A22EJ2E2i)  J 


=  < 


tr  (Eii!2An.2)  +tr  (E22A22) 

( 

Ai2A22A2i  —  Ei2E221A22AJ21A2i 

\ 

+tr 

Vn 

— Ai2A22  A22E22* E2i 

+Ei2E22  A22A22  A22E22E2i 

) 

4 

=  < 


tr  (Ei/^An^)  +tr  (E22A22) 

+tr  (Su'2  [Ei2E22A22  —  Ai2]  A22  [A22E22E2i  —  A2i]) 
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=  < 


tr  (^li^An^)  +  tr  (^22^22) 

+tr  ^£n*2  [A12  -  Si2E221-^-22]  AJ2*  [A12  -  £12^22^22]  ) 


(32) 

Substituting  equations  (26),  (27),  and  (32)  into  the  probability  density  function  of  equa¬ 
tion  (24)  yields 

‘  |A„.2r-" 


/(A)  =  { 


retr  (— £]].2Aii.2) 


l^Petr  (— Ej'Affl) 


•etr  £n!2  [A12  -  £12^22^22]  A221  [Ai2  —  £12^22^22]  ) 


=  < 


|  An.; 


|m  —  (n  —  fc)  —  fc 


rm-(n-fc),fc|Sll-2 


-(n  —  k) 


et^-En^An^) 

'|Aaaf 

fmjft-fc 

—  (n  —  k),k  k 

A 

[  —  k 
^-22  | 

rs  in  — fc 

— '  1 1  -  2 1 

-(n-fc) 


tjj — p-etr  (—£22^22) 


etr  [A12  -  £12^22^22]  A22*  [A12  -  £12^22^22]  )  J 

=  f  (An. 2)  f  (A22)  f  (A12|A22) ,  (33) 

where  it  is  recognized  that  An. 2  and  A22  have  complex  Wishart  distributions, 

A11.2  ~CWfc(m- (n  -  fc),  £11.2)  (34) 


and 


A22  ~  CWn-k  (m,  £22) , 


(35) 


thus  proving  the  first  and  third  parts  of  the  theorem.  The  independence  of  An.2  from 
A 12  and  A22  is  seen  from  the  factorization  of  the  probability  density  function  of  equation 
(33).  The  probability  density  function  of  Ai2  conditioned  on  A22  may  be  simplified  by 
considering 


r  m-(n-k),k^'m,n—k 

f 

*-  m  .n 


r(m— n+fc)-"r(m— n+l)r(m)-r(m— n+fc+l) 
r(m)---r(m— n-f-l) 

1  > 

,,^[k(k-l)+(n-k)(n-k-l)-n(n-l)] 

^  [k2  —  k+n2 — 2nk+k2  —  n+k— n2+n] 


7[-— k(n— k)  _ 


(36) 
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Substituting  equation  (36)  into  the  conditional  probability  density  function  of  A12  yields 

etr  Sj/.j  [A  12  —  Ei2£22  A22]  A22  [A^  —  E12EJ2A22]  j 
7rfc("-fc)  |A22|fc|=11.2rt 

(37) 


/  (A12IA22) 


which  is  recognized  as  the  probability  density  function  of  a  complex  Gaussian  random 
matrix, 

A12IA22  ~  CM kx(n-k)  (Si2Ej2A22,  Eh. 2  ®  A22) ,  (38) 

proving  the  second  part  of  the  theorem. 


THEOREM  4 

The  following  theorem  is  an  extension  of  Theorem  3.2.11  on  page  95  of  Muirhead  [2] 
describing  the  probability  density  function  of  the  inverse  of  a  matrix  quadratic  form 
involving  the  inverse  of  a  complex  Wishart  distributed  matrix. 

Theorem  4  If  A  ~  CW„  (m,  E),  E  is  full  rank,  and  P  is  a  k-by-n  matrix 
with  rank  k,  then 

(PA-1Pff)  *  ~CW*  (m-n  +  k,  (PE-1?")-1^.  (39) 


Proof:  If  E  is  full  rank,  it  may  be  factored  into 

E  =  IT", 

where  T  is  also  of  full  rank.  Set 

B  =  r_1A 

Since  T  is  constant  and  of  full  rank,  B  is  distributed  as 

B  ~  CW„  (m,I„). 


(40) 


(41) 


(42) 
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Define  the  fc-by-n,  rank  k  matrix 


R  =  p 


-1 


(43) 


Substituting  equations  (43)  and  (41)  into  the  matrix  product  described  in  the  theorem 
results  in 

(PA-'P")’1  =  (rT^A-^R 

-  /r  Ir^A^r")-1!  r" 


-1 


(rb_1rw) 


-1 


(44) 


Similarly, 


(45) 


=  R^r_1i:(rw)_1^  nH 

=  (rrh)’\ 

Using  equations  (44)  and  (45),  it  is  seen  that  the  theorem,  as  stated  in  equation  (39), 
simplifies  to  showing  that 

(rB_1Rw)  1  ~CW„  ^m-n  +  it,  (rr")_1^  . 

Using  a  singular  value  decomposition,  the  matrix  R  may  be  factored  into 

R  =  u  [  ik  o  ]  vH, 

where  U  is  k-by-k  and  non-singular  and  V  is  n-by-n  and  orthogonal, 

V-1  -  VH. 

Substituting  this  factorization  into  equations  (44)  and  (45)  results  in 

(rb-1r")-1  =  fu[lfc  o]v"B-1V 


(46) 


(47) 


(48) 


Ik 

0 


u 
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where 


=  (U")_1  (  [  0](V"BV)' 


=  Mil1*  o]c-  * 


c  =  v"bv. 


(rRh)  1  =  (u  Ifc  o  v"v  Ifc  u" 


-  (UIIk  °][o]U") 

=  (uu")_1. 


Cn  Ci 

C21  Co 


C"1  =  D 


Du  Di 

D21  D2 


be  fc-by-n  —  k  partitions  of  C  and  D  =  C  1.  Then,  equation  (49)  becomes 


(rb-1r")  1  =  (u")  ^^U-1 

=  (U^^Cii-aU'1, 


where  Cn.2  is  as  defined  in  Theorem  3  and,  as  seen  in  Muirhead  [2],  is  equal  to  Du1. 
Since  V  is  orthogonal,  C  is  distributed  as 

C~CWn(m,In).  (55) 

Applying  part  (i)  of  Theorem  3,  it  is  seen  that 


Cii.2  ~  CWfc  ( m-n  +  k ,  Ifc) , 


12 


which,  when  applied  to  equation  (54),  results  in 


(rb-1rh) 


-1 


rv,/  CWfc  (  m  —  n  +  k 


,(uu") 

CWk(m-n  +  l fc,  (RRH)  ^  , 


(57) 


which  completes  the  proof. 


THEOREM  5 


The  following  theorem  is  an  extension  of  Theorem  3.2.12  on  page  96  of  Muirhead  [2] 
describing  the  probability  density  function  of  the  ratio  of  quadratic  forms  involving  the 
inverse  of  the  scale  matrix  and  the  inverse  of  a  random  sample  of  a  complex  Wishart 
distribution.  It  is  interesting  to  note  that  the  resulting  distribution  does  not  depend  on 
the  vector  in  the  quadratic  forms  if  it  is  independent  of  the  complex  Wishart  distributed 
matrix. 


Theorem  5  If  A  ~  CWn  (m,  E)  where  m  >  n  —  1  and  if  y  is  any  n-by- 1 
random  vector  independent  of  A  such  that  Pr  (y  =  0)  =  0,  then 


V*A^V  2(m-n+1)’ 

and  is  independent  of  y. 

Proof:  In  Theorem  4,  let  P  =  yH .  Then, 

W  =  (yHA~1y)  1  ~CWi  (m  -  n  +  1,  (yHS_1y)_1)  , 
which  has  probability  density  function, 

im-n+t-1  etr  (_|) 


fw  (w)  = 


r  (m  —  n  +  1)  \8\ 


m— n+1 


where 


r  (rn  —  71  +  1)  grn-n+l  ’ 
^(y^S-iy)-1. 


(58) 


(59) 


(60) 

(61) 
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Performing  the  transformation 


Z  = 


?Vr  =  2 


yH£-1y 

y"A-y 


(62) 


yields  the  desired  scaled  ratio  of  quadratic  forms  in  equation  (58).  The  probability  density 
function  of  Z  is  found  to  be 


fz(z ) 


r  (m  —  n  +  1)  29m~n+1 

zm-n+ 1— le— f 

r  (m  -  n  +  1)  2m-"+1 

H  _  A 

z  2  Ae  2 


(63) 


where 


r  =  2  (m  —  n  +  1) , 


(64) 


which  is  a  central  Chi-squared  distribution  with  2  (m  —  n  +  1)  degrees  of  freedom. 
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